Unconventional strongly interacting Bose-Einstein condensates in optical lattices 
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Feschbach resonances in a non-s-wave channel of two-component bosonic mixtures can induce 
atomic Bose Einstein condensates with a non-zero orbital momentum in the optical lattice, if one 
component is in the Mott insulator state and the other is not. Such non-s-wave condensates break 
the symmetry of the lattice and, in some cases, time-reversal symmetry. They can be revealed in 
specific absorption imaging patterns. 



Unprecedented advances in trapping and manipulat- 
ing ultracold atoms in optical lattices (OLs) 0, U have 
created a growing wave of interest in strongly correlated 
many-body phases and quantum phase transitions. The 
Mott insulator (MI) superfluid (SF) transition 3] realized 
in one-component lattice bosons has inspired predic- 
tions of the variety of novel phases in quantum mix- 
tures. These phases are all described by the Hubbard- 
type Hamiltonian 3| in which the lowest single-particle 
band only is considered in the limit when a typical one- 
particle band gap exceeds considerably the on site in- 
teraction energy. Recently the opposite limit has been 
reached in the s-wave channel. As pointed out by 
Diener and Ho in ref.Q, the resulting effect of the in- 
teraction induced band mixing Q can potentially be a 
source of yet novel quantum phases and phase transi- 
tions. The effects of macroscopic bosonic population of 
higher Bloch bands under strongly non-equilibrium con- 
ditions have been analyzed in detail in rcf. 7J. At com- 
mensurate filling the insulator-superfLuid transition can 
also be observed in the higher bands 0- 

In this Letter, it is shown that Feshbach resonance at 
some L 7^ angular momentum can induce atomic Bose 
Einstein condensate (BEC) which breaks crystal symme- 
tries by means of essentially equilibrium phase transi- 
tion. Such non-s-wave BEC must be contrasted, on one 
hand, with the conventional (s-wave) BEC carrying no 
angular momentum in its ground state and, on the other 
hand, with the paired states in the fermionic systems: 
^He and unconventional superconductors H, • The p- 
wave resonances have been observed in one component 
fermions JJl, Higher-L resonances have been de- 

tected in bosonic ^''Rb and ^^'^Cs systems as 
well. In the latter case spin-orbit coupling creates inter- 
ference between different L channels. Here, however, the 
case of isolated resonance with L > is considered for 
two distinguishable bosonic atoms in OLs in order to dis- 
cuss novel phases and phase transitions in the simplest 
formulation. 

The non-s-wave BECs are characterized by zeros and 
degeneracy. This apparently contradicts to Feynman's 
argument that the bosonic many-body ground state must 
have no zeros In the case L ^ 0, however, the sys- 
tem is not in its absolute ground state due to the closed- 
channel molecular component. Thus, a such BEC must 
be viewed in the context of metastable phases generic 



for atomic traps and OLs, with the stability insured by 
large difference between intra-molecular and atomic cen- 
ter of mass energies. Accordingly, the system can be 
tuned to exhibit quantum phase transitions between the 
traditional and the orbital BECs. 

For two distinguishable and non-convertible bosons, 
e.g., A and B, in OLs, each site can be approximated 
by superimposed isotropic oscillator potentials with fre- 
quencies uJa, i^b and masses nia, rub for the sorts A and 
B, respectively. It is reasonable to choose nia ~ mb = m 
and LOa = ujb — ujq in order to allow decoupling bewteen 
center of mass and relative motions. The one-particle 
states are classified according to the radial number and 
to the value of the angular momentum. The lowest states 

Is, (Ip), (Id, 2s) (1) 

are shown in order of increasing energy from left to right. 
The states Is, 2s carry no agular momentum L. The 
state Ip [L = 1) is triple degenerate and transforms as a 
vector 

■01p = "04 ~ Xi, (2) 

where Xi — x, y, z stand for Cartesian coordinates. The 
state Id with L = 2 is fivefold degenerate and transforms 

as a tensor: -i/'id = ^ij ~ XiXj — \Sij. 

Let's consider a situation of Feschbach resonance in the 
L-wave channel between the species. The corresponding 
closed channel molecular state $Q(r) is characterized by 
some degeneracy index a (for L — 1, a — x,y, z ^H) and 
r stands for the relative coordinate of the A and B atoms. 
The analysis for one site closely follows the approach . 
Its validity for the lattice is determined by smallness of 
a typical intersite tunneling amplitude t in comparison 
with the on site excitation energy luq. The size of the 
molecule is assumed to be much less than the oscillator 
length ro = 1/^/mujo (units h = 1 are employed here 
and below) Introducing the creation-annihilation 

operators for the molecule cj^,, Cq, and for the A and B 
bosons al^, Um and 5]^, 6„, respectively, with m,n refer- 
ring to the oscillator levels, the onsite Hamiltonian can 
be written in the form 

a m 
- ^l(x,mn{cia„^bn + H.C.), (3) 
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with V standing for the bare molecular energy and 
Earn, Sbm labeling the oscillator energy levels. Here 
particle interactions beyond the resonant one are not 
shown explicitly. The resonance-interaction matrix el- 
ements ^a,mn are determined by the strength of the 
open-closed channels coupling and by the symmetry: for 
given a, it selects such states to, n so that the cen- 
ter of mass of the pair resides in the Is oscillator state 
~ exp(— mwoR-^) and their relative motion is character- 
ized by oscillator wavefunction '!/'n(r) with given L. For 
example, for L = 1 the lowest energy term is the Ip state 
V'n=o!{r) ~ exp(— TOu;or^/4)(r)Q, a — x,y,z. Here (for 
equal masses), R = (ra -I- rb)/2, r = Ta — rb and 
and Tb refer to the coordinates of the A and B particles, 
respectively. 

For large enough ja,mn it is natural to expect that, 
upon proper tuning of D, it is possible to make the lowest 
energy El of the AB-pair with relative L to lie below the 
energy Eq ~ e^o + £bo = ■i^o of the Is state for both 
atoms |L = 0) = aJbQjO) (in which that they do not 
participate in the resonance). This is possible because 
no states with L = arc simply present in the expansion 
given by ^a,mn- The ground state should be looked for 
in the form 6]: 

|L,a)=BljO), i?L=/3ct-H^r;„„aL6t, (4) 

mn 

with 0^ + J2mn''^mn — 1; ^ud the Summation running 
over the oscillator states corresponding to the a orbital 
of the chosen L. Then, El must be compared with Eq. 
The full procedure of finding (i,rimn,EL requires proper 
renormalization of the detuning v . Some complication 
also comes from the sensitivity of the eigenenergies to mi- 
croscopic details of <i>a(r)- One can, however, choose the 
variational approach in order to obtain the upper hound 
estimate for El in terms of the matrix elements ^a.mn 
admixing the lowest oscillator levels only. Hence, if the 
condition El < Eq holds for the upper bound of El, 
it will be satisfied within the exact scheme for sure. 
This also helps establishing the symmetry and topologi- 
cal properties of the phase because these do not depend 
on the number of states involved in the expansion 

In the case L — 1, the lowest relevant oscilla- 
tor states are Is and Ip from the nomenclature 
Then, the two-body wavefunction in the open channel 
^0Q(ra,r6) ~ exp(— mcjoR^) exp(— TOa;or^/4)(r)a can be 
expanded as ~ exp(— mti;ora/2)(ra)a exp(— TOWor^/S) — 
exp(— TOWorh/2)(rh)Q, exp(— TOWofa/S). This translates 
into truncating the expansion Q by the lowest terms 
only: \L = = [f3c^ + T^ialbl - blai)]\0), with 

/52 + 2772 = 1. Then, El ^ {L ^ l,a\H\a,L = 1) se- 
lects only the terms with ja,Oa = —Ja,aO = 7 in eq.lO. 
The resulting upper bound estimate for the ground state 
energy is El = {D + 4ujo) / 2 ~ ^/{p^^iuJojyT^^h^ ■ If D is 
tuned to « 4a;oj then El ~ 4:IjJq — \^\ and the requirement 
El < Eq translates into 

I7I > ^0, (5) 



so that \L = 1, a) becomes the ground state. Tuning D (or 
its renormalized value Q) to higher values will eventually 
raise the energy El above Eq. In contrast, if I7I < luq, 
no effect is most likely to be observed for any D. 

The value of 7 is determined by exchange interac- 
tion Vex on molecular distances further reduced by small 
overlap between the closed and open channels. Using 
Vex leV on atomic distances Qq ~ 10~^cm and taking 

^ Inm 16] and 7'o ^ 10~'*cm, the estimate for arbi- 
trary L gives 7 ~ Vex{aQ/r^){r^/ro)^/'^+^, where it was 
taken into account that the wave function of the relative 
motion is ^ at the origin. For the p-wave case {L = 1) 
one finds 7 « 30/zK« 3MHz. This shows plenty of room 
for satisfying the condition (0 for typical OL frequencies 
in the range of few kHz. Clearly, higher resonances with 
L — 2,3... will be characterized by smaller 7. In terms 
of the typical exchange matrix element Vex — V'ear^/ao, 
the typical molecular kinetic energy eo ~ l/(mr^) and 

/ro the estimate as a function of L becomes 

7/t^o« (V;.Ao)(r0/ro)^-i/2. (6) 

For chosen parameters, this gives ~ 
10^(r^/ro)'^^^/2, and the condition Q can be sat- 
isfied by L ~ 1,2. Choosing to work with smaller tq, 
about ro ~ 10~^cm, will allow realization of the ground 
state with L as high as L = 3. For higher L, however, 
it becomes important that the one particle band gap is 
Lwo, and the condition jSJ must, actually, be 7 > Lujq. 

Non-s-wave Bose-Einstein condensate of the A+B 
mixture. — Starting from the deep MI "vacuum" of A- 
bosons \MI) = nf "^olOlO) ^^e lattice of N sites, 
one can add a small number Nb <C iV of B-bosons in 
the regime of the L-wave A-l-B resonance. This will re- 
sult in formation of the onsite states l@J. In the limit of 
weak tunneling such resonant complexes will dclocalize 
over the lattice without changing their shape. 

The state Q is characterized by strong entanglement, 
and it is important to verify that this is not in a con- 
flict with the formation of the off-diagonal long range 
order (ODLRO). The operator i3|^(z)ao(z) creates one 
excitation on a site i from \MI). Here and below the 
dependence on the site index i is shown explicitly. For 
low density of the excitations, it is enough to verify that 
one excitation forming a band wave 

contributes constructively to the ODLRO density matrix 

pl^Uhj) = {MI\BLc.bl{i)bn{j)BljMI) in the limit 

|xi — Xjl —>■ 00. Direct calculation gives pmn(i, j) — 
VonVom/N. For 1< A^B < iV: 

Plniihj) = VLVOmriB, (8) 

where ub = Nb/N, with the index n referring to the on- 
site oscillator states with the selected (by the resonance) 
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angular momentum L of a B-particle. It is worth not- 
ing quite significant quantum depletion of the condensate 
density even in the limit ns ^ 1 due to |?7on| < 1- Within 
the variational approach discussed above, rjQn is to be re- 
placed by 77, and the indices m, n must be set equal to 
a given a-orbital of the, e.g., Ip oscillator state [131 . It 
is important to note that no other channel contains the 
ODLRO, that is, (6j(i)6o(j)) = 0, (aj„(i)a„(j)) = and 

{ci{i)Ca'{j)) = for X; ^ Xj. 

Macroscopic properties of the p-wave BEC. — Any L > 
0-wave BEC have zero population of the zero-momentum 
state even in an infinite and uniform system. This follows 
from vanishing of the space integral of any non-s orbital 
function. In other words, / dxVF(j(x — x^) = where 
M^q(x — Xi) stands for a non-s- wave Wannier function 
localized at the coordinate x^ of the zth site. This leads 
to quite unusual macroscopic properties 0. 

Let's consider, first, two neighboring sites, say, i and j. 
Then, the tunneling part of the Hamiltonian can be con- 
structed following the standard procedure |l8j | . The sym- 
metry condition ||2J) immediately implies that no tunnel- 
ing takes place between states with different a ~ x^y, z. 
Furthermore, since Wa{'X-) is odd for the p-wave, the tun- 
neling amplitude t,-"'' is negative along the orientation of 
the a-orbital and positive if perpendicular. The reason 
for that is that the combination VFq,(x — Xi)-|-Il/Q,(x — Xj) 
for a being along the direction x^ — Xj has one extra 
zero in comparison with the one VFq(x— x^) — iyQ,(x— Xj). 
Thus, the lowest energy of the secular equation corre- 
sponds to the antisymmetric combination. In general, 
the sign of depends on mutual orientation of the 
vector u = (x^ — Xj)/|xi ~ Xj| and of the orbital. If 
Ux = 1, Uy — 0, — and the orbital assignment 
is taken according to the x-axis being along u, then, 
there are two non-zero values in the set t^jK These are 

t|l <Oand = = > 0. 

The lattice Hamiltonian formulated in terms of the 
lowest L = 1-band operators becomes 

in the hard-core approximation ba{i)bi3{i) = 0. The last 
term in eq.® describes the effect of external rotation of 
the lattice at some angular frequency CI, with Lq,^ stand- 
ing for the angular momentum operator L built on the 
on site Wannier functions: Lap = J cZxW*(x)LW/3(x). 
Thus, in addition to the possibility of introducing vor- 
tices, external rotation induces mixing between the com- 
ponents. The mixing can also be induced by the exchange 
onsite interactions [Jl- 

In general, properties of the non-s-wave BEC depend 
strongly on the lattice symmetry and its structural de- 
fects and boundaries. In particular, the translational lat- 
tice symmetry is broken. For the p-wave BEC, the phase 
(fir in {ba{r)) ~ e^'^'' must oscillate as ipr = ""(l + l— 1)'")/2 
along the direction of the orbital in order to lower the 



tunneling energy. Such a tendency to form spatial super- 
structure of the phase can lead to spontaneous ground 
state currents in, e.g., the triangular lattice because of 
the sign frustration along the elementary plaquet. 

In the tetragonal lattice the condensation proceeds into 
either p — z or the p = x,y states. If the z-axis lattice 
constant is the shortest one, the tunneling energy will 
be gained by forming the one-component z-BEC. In the 
opposite case, the two-component xy-BEC occurs with 
two options: (i) The order parameter (OP) is real of 
the type x ± y; (ii) the OP is complex as x ± iy and, 
therefore, it breaks the time-reversal symmetry. What 
option is actually reahzed depends on the details of the 
interaction. On the mean field level, in the xy-BEC two 
components and must be considered 3 ■ The corre- 
sponding Landau expansion obeys the lattice symmetry. 
Thus, the quadratic IV'i^.yP and the gradient terms do 
not distinguish between the options. Among the quar- 
tic terms, there is one Ht = J d?'xgt{4>'^4'y + c.c.) which 
determines the phase locking between the components 
similarly to the situation in the d-wave superconductor 
01 . ligt < 0, the option (i) takes place. Then, the phases 
(fix and (fiy are equal to each other and the condensation 
proceeds into the state ipx ± V'y with \ipy \ = {ipxl = y/Pp- 
Accordingly, the line of zeros will be arranged along the 
plane x — ^y. If, however, gt > 0, the energy can be 
lowered if ipx — (py = ±7r/2, so that there are no zeros 
in ip± — tpx i^y Then, similarly to the case of the 
d-wave superconductor 19|, the ground state can have 
spontaneous fractional vortices initiated close to the OLs 
boundaries and structural defects. 

The Josephson effect can also feature spontaneous cur- 
rents [19I I even though the time-reversal is not broken. If 
the p-orbital BEC is surrounded by the s-wave BEC of 
the same particles, the tunneling current Jc{d) between 
two BECs will strongly depend on the angle between 
the orientations of the orbital u and of the boundary n*^"' . 
If u • n^*-' = 0, no tunneling will take place because the 
current from the positive part of the lobe of the p-orbital 
will be exactly compensated by the current from the neg- 
ative part. In general, Jc{0) ~ cos 6*. Thus, there will be 
a phase jump of tt for a contour traversing both SFs so 
that 6 changes by 180° along it. This implies that a spon- 
taneous vortex, carrying 1/2 of the standard circulation, 
can form if the system size R is macroscopic in compar- 
ison with the healing length and any length associated 
with the Josephson coupling. 

L-wave Mott insulator. — At Nb — N and for strong 
s-wave intraspecies repulsion the system becomes MI 
with broken lattice (including time-reversal) symmetries 
(compare with the single boson case 0)- Obviously, tun- 
ing away from the L-wave resonance will result in a phase 
transition into the two-component MI with no broken 
symmetries. The nature of the L-wave MI as well as of 
the phase transition requires separate analysis. 

Detection. — Non-s-wave condensates should produce 
specific absorption imaging patterns due to condensation 
into the k ^ state For example, considering the op- 
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tions (i) and (ii), the V'a=i.2 operator becomes 

V^a(x) = ^-(^ - x,)6a(*), a = 1, 2. (10) 

i 

The Wannier function can be taken as Wi(x) « 

aj'^'^ /^""(a; ± y), with a„ « tq, in the case 
of the time-invariant state (i) and as W^iy^) ~ 

a^^"^ e^^^ l'^°'^^(x ± iy) in the case (ii) of the broken 
time-reversal symmetry. After atoms are released from 
the lattice and some free expansion, the cloud de nsity 
nB{x,t) of the B-atoms in the far zone becomes [20j : 
ns(x,i)^ ~ |VF4q)|2^,;^.exp(*q(x, - x,))(&I(*)&a(j)), 

where Wa(q) stands for the Fourier transform of VFa(x) 
with the momentum q = mx/t. These transforms 
#'i(q) « i-5/2(a; ± y) and 1^2 (q) « t-5/2(a: ± iy) 
should be contrasted with the one for the s-wave BEC, 
~ ^-3/2 rpj^g expressions 2(q) feature modulation of 
the standard Bragg peaks by the factors {x ± y)^/t^ 
and (x^ + y'^)/t^ for the options (i) and (ii), respectively. 
In the first case, the peaks along the line (in the colum- 
nar image) x = =py will be suppressed. In the second, 
the central Bragg spot only will be strongly suppressed. 
In general, the imaging pattern reflects the symmetry of 
the orbital and of the lattice. [Similar expression can 
be easily obtained for the p-wave-BEC with the OP of 
the z-type.] The corresponding patterns are recognizable 
by the lines of zeros or by the suppression of the cen- 
tral Bragg peak. Higher L condensates will feature more 



complex patterns. It is worth noting that rotation of the 
lattice can produce switching between the patterns, e.g., 
from (i) to (ii) because finite fl in eq.© promotes fer- 
romagnetic ordering of the on site angular momenta - 
the state (ii): ~ x ± iy, with the sign chosen by the 
direction of VI. 

In conclusion, Feshbach resonance in a non-zero an- 
gular momentum channel favors formation of the non-s- 
wave BEC characterized by space-time symmetries lower 
than those of the OLs. The ground state contains lines 
of zeros and spontaneous currents induced by bound- 
aries and structural defects. The absorption images ex- 
hibit additional strong modulational patterns reflecting 
the non-trivial symmetry of the ground state. Imposing 
non-s-wave Feschbach resonance on a lattice with double 
occupation in MI regime can induce insulating phases 
with broken lattice symmetry. Varying the detuning of 
non-s-wave resonance can lead to various quantum phase 
transitions between the phases: S-wave BEC, non-S-wave 
BEC, conventional MI and orbital MI (with broken lat- 
tice symmetries). 

Similar conclusions about properties of the p-orbital 
BEC have been obtained in Refs. 21], where the case of 
a boson-fermion mixture in OLs was analyzed. 

This work was supported by NSF, Grant PHY- 
0426814, and by the PSC, Grant CUNY-66556-0036. 
The author acknowledges hospitality of the Aspen Center 
for Physics during the Summer Workshop on ultra-cold 
atoms when this work was initiated. 



[1] M. Greiner, et al. Nature 415, 39(2002). 

[2] S. Foiling, et al., Nature 434, 481 (2005) 

[3] M. P. A. Fisher, et al. Phys. Rev. B 40, 546 (1989) 

[4] E. Dernier and F. Zhou Phys. Rev. Lett. 88, 

163001(2002); A.B. Kuklov and B.V. Svistunov, Phys. 

Rev. Lett. 90, 100401(2003); L.-M. Duan, E. Dernier, 

and M.D. Lukin, Phys. Rev. Lett. 91, 090402(2003). M. 

Lewenstein, et al. Phys. Rev. Lett. 92, 050401 (2004). 
[5] M. Kohl, et al. Phys. Rev. Lett. 94, 080403 (2005) 
[6] R. B. Diener, T.-L. Ho, Phys. Rev. Lett. 96, 010402 

(2006). 

[7] A. Isacsson and S. M. Girvin, Phys. Rev. A 72, 053604 
(2005). 

[8] E. M. Lifshitz, L. P. Pitaevskii, Ch.V.54, Statistical 
Physics. II, Pergamon (1980); P. W. Anderson and P. 
Morel, Phys. Rev. Lett. 5, 136 (1960); ibid, 5, 282 (1960); 
Phys. Rev. 123, 1911 (1961). 
[9] M. Sigrist and K. Ueda, Rev. Mod. Phys. 63, 239 (1991). 
[10] C. A. Regal, et al., Phys. Rev. Lett. 90, 053201 (2003). 
[11] C. Ticknor, et. al., Phys. Rev. A 69, 042712 (2004). 
[12] T. Volz, et al., Phys. Rev. A 72, 010704(R) (2005). 
[13] C. Chin, et al., Phys. Rev. Lett. 85, 2717 (2000); P. J. 



Leo, C. J. Williams, and P. S. Julienne, ibid, p. 2721. 
[14] R.P. Feynman, Statistical Mechanics. A set of lectures. 
Frontiers of Physics, Ch. 11.3. Ed: D. Pines. Reading- 
Tokyo, 1976. 

[15] This degeneracy can be removed by magnetic dipole [Tll | 
or spin-orbit interactions. While introducing some com- 
plexity into the analysis, such circumstance does not 
change the main conclusions. 

[16] F. Chevy, et al., Phys.Rev. A 71, 062710 (2005). 

[17] The presence of higher excited states with given L and 
a in pSn{i,j) is essentially the same effect discussed 
m Ref.fl for the s-wave fermionic resonance . Since all 
bands with given L have the same symmetry, it is enough 
to consider the lowest one only. 

[18] D. Jaksch, et al., Phys. Rev. Lett. 81, 3108-3111 (1998). 

[19] M. Sigrist, D. B. Bailey, and R. B. Laughlin Phys. Rev. 
Lett. 74, 3249 (1995). 

[20] V.A. Kashurnikov, N.V. Prokof'ev, and B.V. Svistunov, 
Phys. Rev. A 66, 031601 (R) (2002). 

[21] W. V. Liu C. Wu, Phys. Rey .A 74, 013607 (2006); C. 
Wu, et al., |cond-mat/0606743| 



